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DETAILED ACTION 

1 . This office action is in response to the application filed 19 November 2001 , and 
the Information Disclosure Statements filed 5 June 2002 and 22 July 2002. 

2. Claims 1-45 are pending. Claims 1, 8, 13. 15, 17, 24, 29, 31, 33, 37, 42, and 44 
are independent. 



Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claims 31 and 32 are rendered indefinite. 

As per independent claim 31 , the term "first user-selectable identifier" in claim 31 , 
lines 19-20, is unclear and renders the claim indefinite. The claim requires the 
information stored in a first and second multimedia document to correspond to the first 
user-selectable identifier. It is unclear how the first user-selectable identifier 
corresponds to both the first and second multimedia document. 

As per dependent claim 32, it is rendered unclear based upon its dependence 
upon claim 31. 

Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this 
title before the Invention thereof by the applicant for patent. 

The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act 
of 1999 (AlPA) and the Intellectual Property and High Technology Technical 
Amendments Act of 2002 do not apply when the reference is a U.S. patent resulting 
directly or indirectly from an international application filed before November 29, 2000. 
Therefore, the prior art date of the reference is determined under 35 U.S.C. 102(e) prior 
to the amendment by the AlPA (pre-AlPA 35 U.S.C. 102(e)). 
6. Claims 1 , 4, 7-9, 17, 20, 23-25, 33, and 36-38 are rejected under 35 
U.S.C. 102(e) as being anticipated by Mao et al. (U.S. 6,546,385). 

As per independent claim 1 , Mao discloses a computer implemented method of 
using a paper document to retrieve multimedia information stored in a multimedia 
document in electronic form, wherein one or more user-selectable identifiers are printed 
on the paper document, the method comprising: 

• Receiving a first signal indicating selection of a first user-selectable identifier from 
the one or more user-selectable identifiers printed on the paper (Figure 4, items 
404 and 414) 

• Responsive to receiving tlie first signal, identifying a portion of multimedia 
information stored by tlie multimedia document corresponding to the first user- 
selectable identifier (Figure 4, item 410) 

• Outputting the portion of the multimedia information corresponding to the first 
user-selectable Identifier using an output device (Figure 4, item 415) 
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As per dependent claim 4, IVIao discloses the method wherein one or more user- 
selectable identifiers include one or more barcodes printed on the paper document 
(Figure 4, items 414 and 416). 

As per dependent claim 7, Mao discloses the limitations similar to those in claim 
1, and the same rejection is incorporated herein. Mao discloses receiving a signal 
indicating a selection of a control code from one or more control codes printed on the 
paper document (Figure 4. items 404, 406, 414, and 416). Mao further discloses 
responsive to receiving a signal, controlling the output of the portion of the multimedia 
information corresponding to the user-selectable identifier based upon the control code 
(Figure 4, items 415 and 434: Here, depending on the control code, the multimedia 
information can be sent to either display, 415, or a PC, 434). 

As per independent claim 8, Mao discloses the method of using a paper 
document to access multimedia information stored in a multimedia document in 
electronic form, wherein one or more user-selectable identifiers printed on the paper 
document, the method comprising: 

• Selecting a first user-selectable identifier from the one or more user-selectable 
identifiers printed on the paper document (Figure 4, items 404 and 414) 

• Requesting multimedia information corresponding to the first user-selectable 
identifier (Figure 4, item 410) 

• Outputting a portion of the multimedia information stored by the multimedia 
document corresponding to the first user-selectable identifier using an output 
device (Figure 4, item 415) 
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As per dependent claim 9, Mao discloses the method wherein the one or more 
user-selectable identifiers correspond to one or more barcodes printed on the paper and 
selecting the first user selectable identifiers comprises scanning a first barcode from the 
one or more barcodes printed on the paper document using a selection device (Figure 
4, items 414 and 416). 

As per independent claim 17, Mao discloses the system for using a paper 
document to retrieve multimedia information stored in a multimedia document in 
electronic form, wherein one or more user-selectable identifiers are printed on the paper 
document, the system comprising: 

• An output device (Figure 4, item 415) 

• A data processor (Figure 4, item 41 1 ) 

• Wherein the data processor is configure to: 

o Receive a first signal indicating selection of a first user-selectable identifier 

from the one or more user-selectable identifiers printed on the paper 

document (Figure 4, items 404, 406, 414 and 416) 
o Identifying a portion of multimedia informafion stored by the multimedia 

document corresponding to the first user-selectable identifier (Figure 4, 

path from 416 to 414 to 418 to 410 to 411 to 412) 
o Communicating the portion of the multimedia information corresponding to 

the first user-selectable identifier to the output device (Figure 4, path from 

412 to 411 to 410 to 415) 
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o Wherein the output device is configured to output the portion of the 
multimedia information corresponding to the first user-selectable identifier 
received from the data processor (Figure 4, item 415) 

As per dependent claim 20, Mao discloses the method wherein one or more 
user-selectable identifiers include one or more barcodes printed on the paper document 
(Figure 4, items 414 and 416). 

As per dependent claim 23, Mao discloses the limitations similar to those in claim 
17, and the same rejection is incorporated herein. Mao discloses receiving a signal 
indicating a selection of a control code from one or more control codes printed on the 
paper document (Figure 4, items 404, 406, 414, and 416). Mao further discloses 
responsive to receiving a signal, controlling the output of the portion of the multimedia 
information corresponding to the user-selectable identifier based upon the control code 
(Figure 4, items 415 and 434: Here, depending on the control code, the multimedia 
information can be sent to either display, 415, or a PC, 434). 

As per independent claim 24, Mao discloses a system for using a paper 
document to access multimedia information stored in a multimedia document in 
electronic form, wherein one or more user-selectable identifiers are printed on the paper 
document, the system comprising: 

• A processor (Figure 4, item 411) 

• A memory coupled to the processor, the memory configured to store a plurality of 
code modules for execution by the processor, the plurality of code modules 
comprising: 



Application/Control Number: 1 0/001 ,894 Page 7 

Art Unit: 2178 

o A code module for selecting a first user-identifier from the one or more 
user-selected identifiers printed on the paper document (Figure 4, item 
410) 

o A code module for requesting multimedia information corresponding to the 

first user-selectable identifier (Figure 4, item 410 and 420) 
o A code module for outputting a portion of the multimedia information 
stored by the multimedia document corresponding to the first user- 
selectable identifier using an output device (Figure 4, item 415) 
As per dependent claim 25, Mao discloses the method wherein the one or more 
user-selectable identifiers correspond to one or more barcodes printed on the paper and 
selecting the first user selectable identifiers comprises scanning a first barcode from the 
one or more barcodes printed on the paper document using a selection device (Figure 
4, items 414 and 416). 

As per independent claim 33, Mao discloses a computer program product stored 
on a computer-readable storage medium for using a paper document to retrieve 
multimedia information stored in a multimedia document in electronic form, wherein one 
or more user-selectable identifiers are printed on the paper document, the computer 
program product comprising: 

• Code for receiving a first signal indicating selection of a first user-selectable 
identifier from the one or more user-selectable identifiers printed on the paper 
document (Figure 4, items 404, 406, 414, and 416) 
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• Code for identifying a portion of multimedia information stored by the multimedia 
document corresponding to the first user-selectable identifier (Figure 4, items 
404,410.412, and 414) 

• Code for outputting the portion of the multimedia information using an output 
device (Figure 4, item 415) 

As per dependent claim 36, Mao discloses the limitations similar to those in claim 
33, and the same rejection is incorporated herein. Mao discloses receiving a signal 
indicating a selection of a control code from one or more control codes printed on the 
paper document (Figure 4, items 404, 406, 414, and 416). Mao further discloses 
responsive to receiving a signal, controlling the output of the portion of the multimedia 
information corresponding to the user-selectable identifier based upon the control code 
(Figure 4, items 415 and 434: Here, depending on the control code, the multimedia 
information can be sent to either display, 415, or a PC, 434). 

As per independent claim 37, Mao discloses a computer program product stored 
on a computer-readable medium for using a paper document to access multimedia 
information stored in a multimedia document in electronic form, wherein one or more 
user-selectable identifiers are printed on the paper document, the computer program 
product comprising: 

• Code for selecting a first user-selectable identifier from the one or more user- 
selectable identifiers printed on the paper document (Figure 4, items 404, 406, 
414, and 416) 
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• Code for requesting multimedia information corresponding to the first user- 
selectable identifier (Figure 4, items 404, 410, 412, and 414) 

• Code for outputting^a portion of the multimedia information stored by the 
multimedia document corresponding to the first user-selectable identifier using an 
output device (Figure 4, item 415) 

As per dependent claim 38, Mao discloses the method wherein the one or more 
user-selectable identifiers correspond to one or more barcodes printed on the paper and 
selecting the first user selectable identifiers comprises scanning a first barcode from the 
one or more barcodes printed on the paper document using a selection device (Figure 
4, items 414 and 416). 



Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 2-3 and 18-19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Mao in further view of Mohan (Text-based search of TV news stories, 1996, 
provided by applicant in IDS). 

As per dependent claim 2, Mao discloses the limitations similar to those in claim 
1 , and the same rejection is incorporated herein. Mao fails to disclose the method 
wherein a signal comprises information identifying the output device. Mohan further 
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discloses the method wherein a signal comprises information identifying the output 
device (page 1 1 , paragraph 1 : Here, the correct display device is automatically 
invoked). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of document identification and 
display with Mohan's method of automatically determining the viewer for the document, 
since it would have allowed a user to simply open the document without having to 
specifically identify a viewer for the document. 

As per dependent claim 3, Mao discloses the limitations similar to those in claim 
1 , and the same rejection is incorporated herein. Mao further discloses outputting the 
portion of the multimedia information using an output device (Figure 4, item 41 5). Mao 
fails to disclose the first signal comprising information indicating a playback mode for 
outputting the portion of the multimedia information corresponding to the first user- 
selectable identifier. Mohan discloses the first signal comprising information indicating a 
playback mode for outputting the portion of the multimedia information corresponding to 
the first user-selectable identifier (page 1 1 , paragraph 1 ). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of document display with Mohan's 
method of indicating a playback mode, since it would have allowed a user to playback 
the selected multimedia without distinctly specifying a playback device. 

As per dependent claim 18, Mao discloses the limitations similar to those in claim 
17, and the same rejection is incorporated herein. Mohan further discloses the method 
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wherein a signal comprises information identifying the output device (page 1 1 , 
paragraph 1 : Here, the correct display device is automatically invoked). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of document identification and 
display with Mohan's method of automatically determining the viewer for the document, 
since It would have allowed a user to simply open the document without having to 
specifically identify a viewer for the document. 

As per dependent claim 19, Mao discloses the limitations similar to those in claim 
17, and the same rejection is incorporated herein. Mao further discloses outputting the 
portion of the multimedia information using an output device (Figure 4, item 415). Mao 
fails to disclose the first signal comprising information indicating a playback mode for 
outputting the portion of the multimedia information corresponding to the first user- 
selectable identifier. Mohan discloses the first signal comprising information indicating a 
playback mode for outputting the portion of the multimedia information corresponding to 
the first user-selectable identifier (page 1 1 , paragraph 1 ). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of document display with Mohan's 
method of indicafing a playback mode, since it would have allowed a user to playback 
the selected multimedia without distinctly specifying a playback device. 
9. Claims 5, 10, 16, 21, 26, 32, 34, 39, and 45 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Mao in further view of Myers et al. (A Multi-Vie Intelligent 
Editor for Digital Video Libraries, 24 June 2001 , provided by applicant in IDS). 
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As per dependent claim 5, Mao discloses the limitations similar to those in claim 
1 , and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user), 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 10, Mao discloses the limitations similar to those in claim 
8, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
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information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 16, Mao discloses the limitations similar to those in claim 
15, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
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(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 21 , Mao discloses the limitations similar to those in claim 
17, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
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Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 26, Mao discloses the limitations similar to those in claim 
24, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 32, Mao discloses the limitations similar to those in claim 
31 , and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
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including a portion of multimedia Information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 34, Mao discloses the limitations similar to those in claim 
33, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time conresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However. Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
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multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 39, Mao discloses the limitations similar to those in claim 
37, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined IVIao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 45, Mao discloses the limitations similar to those in claim 
44, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time and a second time corresponding to the first user selectable identifier and 
including a portion of multimedia information stored by the multimedia document 
occurring between the first time and the second time in the portion of multimedia 
information corresponding to the first user-selectable identifier. However, Myers 
discloses determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier 
(section 6.5: Here, the first and second identifiers are inherent. Myers discloses 
playback of a "selected portion of the video." For this to occur, a first (start) time and a 
second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of multimedia playback with 
Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 
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10. Claims 6, 1 1 , 22, 27, 35, and 40 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mao in further view of Chiu et al. (Automatically Linking Multimedia 
Meeting Documents by Image Matching, 2000, provided by applicant in IDS). 

As per dependent claim 6, Mao discloses the limitations similar to those in claim 
1 , and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
the multimedia information stored by the multimedia document occurring from the first 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier. However, Chiu discloses determining a first time corresponding to the first 
user-selectable identifier and including a portion of the mulfimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
Information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2, Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying mulfimedia information corresponding to the first fime, since 
it would have allowed a user to view information specifically related to the selected 
identifier without having to search the entire multimedia document to find the 
information. 

As per dependent claim 1 1 , Mao discloses the limitations similar to those in claim 
8, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
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the multimedia information stored by the multimedia document occurring from the first 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier. However, Chiu discloses determining a first time corresponding to the first 
user-selectable identifier and including a portion of the multimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2, Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying multimedia information corresponding to the first time, since 
it would have allowed a user to view information specifically related to the selected 
identifier without having to search the entire multimedia document to find the 
information. 

As per dependent claim 22, Mao discloses the limitations similar to those in claim 
17, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
the multimedia infonmation stored by the multimedia document occurring from the first 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier. However, Chiu discloses detennining a first time corresponding to the first 
user-selectable identifier and including a portion of the multimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
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information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2. Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying multimedia information corresponding to the first time, since 
it would have allowed a user to view information specifically related to the selected 
identifier without having to search the entire multimedia document to find the 
information, 

As per dependent claim 27, Mao discloses the limitations similar to those in claim 
24, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
the multimedia information stored by the multimedia document occurring from the first 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier. However, Chiu discloses determining a first time corresponding to the first 
user-selectable identifier and including a portion of the multimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2, Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying multimedia information corresponding to the first time, since 
it would have allowed a user to view information specifically related to the selected 
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identifier without liaving to search the entire multimedia document to find the 
information. 

As per dependent claim 35. Mao discloses the limitations similar to those in claim 
33, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
the multimedia information stored by the multimedia document occurring from the first 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier. However, Chiu discloses detemiining a first time corresponding to the first 
user-selectable identifier and including a portion of the multimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2, Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying multimedia information corresponding to the first time, since 
it would have allowed a user to view information specifically related to the selected 
identifier without having to search the entire multimedia document to find the 
information. 

As per dependent claim 40, Mao discloses the limitations similar to those in claim 
37, and the same rejection is incorporated herein. Mao fails to disclose determining a 
first time corresponding to the first user-selectable identifier and including a portion of 
the multimedia information stored by the multimedia document occurring from the first 
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time in the portion of multimedia information corresponding to the first user-selectable 
identifier. IHowever, Chiu discloses determining a first time corresponding to the first 
user-selectable identifier and including a portion of the multimedia information stored by 
the multimedia document occurring from the first time in the portion of multimedia 
information corresponding to the first user-selectable identifier (page 2, Figure 1 and 
text; Figure 2, Paper Interfaces section). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of displaying multimedia with 
Chiu's method of displaying multimedia information corresponding to the first time, since 
it would have allowed a user to view information specifically related to the selected 
identifier without having to search the entire multimedia document to find the 
Infomiation. 

1 1 . Claims 12, 28, and 41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mao In further view of Dimitrova et al. (Video Keyframe Extraction 
and Filtering: A Keyframe is not a Keyframe to Everyone, 1997, provided by applicant in 
IDS). 

As per dependent claim 12, Mao discloses the limitations similar to those in claim 
8, and the same rejection is incorporated herein. Mao further discloses the method 
wherein one or more control codes are printed on the paper document, the method 
further comprising selecting a first control code from the one or more control codes 
printed on the paper document (Figure 4, items 404, 406, 414, and 416). Mao fails to 
discloses modifying the output portion of the multimedia information. However, 
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Dimitrova discloses modifying the output portion of the multimedia information (page 
1 14, section 2: Here, Dimitrova discusses segmenting a multimedia video clip). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of receiving paper based user- 
selectable control codes with Dimitrova's method of modifying output of the portion or 
multimedia information, since it would have allowed a user to specify changes that 
he/she wished to be made in the multimedia document. 

As per dependent claim 28, Mao discloses the limitations similar to those in claim 
24, and the same rejection is incorporated herein. Mao further discloses the method 
wherein one or more control codes are printed on the paper document, the method 
further comprising selecting a first control code from the one or more control codes 
printed on the paper document (Figure 4, items 404, 406, 414, and 416). Mao fails to 
discloses modifying the output portion of the multimedia information. However, 
Dimitrova discloses modifying the output portion of the multimedia information (page 
114, section 2: Here, Dimitrova discusses segmenting a multimedia video clip).. 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of receiving paper based user- 
selectable control codes with Dimitrova's method of modifying output of the portion or 
multimedia information, since it would have allowed a user to specify changes that 
he/she wished to be made in the multimedia document. 

As per dependent claim 41 , Mao discloses the limitations similar to those in claim 
37, and the same rejection is incorporated herein. Mao further discloses the method 
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wherein one or more control codes are printed on the paper document, the method 
further comprising selecting a first control code from the one or more control codes 
printed on the paper document (Figure 4, items 404, 406, 414, and 416). Mao fails to 
discloses modifying the output portion of the multimedia information. However, 
Dimitrova discloses modifying the output portion of the multimedia information (page 
1 14, section 2: Here, Dimitrova discusses segmenting a multimedia video clip). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of receiving paper based user- 
selectable control codes with Dimitrova's method of modifying output of the portion or 
multimedia information, since it would have allowed a user to specify changes that 
he/she wished to be made in the multimedia document. 
12. Claims 13, 29, and 42 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mao in further view of Chen et al. (V/BE: A Video Indexing and 
Browsing Environment, September 1999, provided by applicant in IDS). 

As per independent claim 13, Mao discloses a computer-implemented method of 
using a paper document to retrieve multimedia information stored electronically in a 
multimedia document, wherein a first plurality of user-selectable identifiers are printed 
on the paper document, the method comprising: 

• Receiving a signal indicating selection of a plurality of user-selectable identifiers 

from the first plurality of user-selectable identifiers printed on the paper document 

(Figure 4, items 404, 406, 414, and 416) 
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• Responsive to receiving the first signal, identifying portions of multimedia 
information stored by the multimedia document corresponding to the second 
plurality of user selectable identifiers (Figure 4, items 410, 41 1 , and 412) 

• Outputting the portions of the multimedia information corresponding to the 
second plurality of user-selectable identifiers using an output device (Figure 4, 
item 415) 

Mao fails to disclose the second plurality of user-selectable identifiers being a subset of 
the first plurality of user-selectable identifiers. However, Chen discloses organizing 
items into subsets (Figure 3; section 3). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's method of outputting multimedia 
information with Chen's method of organizing user-selectable identifiers into subsets, 
since it would have allowed a user to have similar operations grouped together (Chen: 
section 3.1). 

As per independent claim 29, Mao discloses a system for using a paper 
document to retrieve multimedia information stored electronically in a multimedia 
document, wherein a first plurality of user-selectable identifiers are printed on the paper 
document, the system comprising: 

• An output device (Figure 4, item 41 5) 

• A data processor (Figure 4, item 41 1 ) 

• Wherein the data processor is configured to: 
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o Receiving a signal indicating selection of a plurality of user-selectable 
Identifiers from the first plurality of user-selectable identifiers printed on the 
paper document (Figure 4, items 404, 406, 414, and 41 6) 

o Responsive to receiving the first signal, identifying portions of multimedia 
information stored by the multimedia document corresponding to the 
second plurality of user selectable identifiers (Figure 4, items 410, 41 1 , 
and 412) 

o Outputting the portions of the multimedia information corresponding to the 
second plurality of user-selectable identifiers using an output device 
(Figure 4, item 415) 

Mao fails to disclose the second plurality of user-selectable identifiers being a subset of 
the first plurality of user-selectable identifiers. However, Chen discloses organizing 
items into subsets (Figure 3; section 3). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao's system of outputting multimedia 
information with Chen's system of organizing user-selectable identifiers into subsets, 
since it would have allowed a user to have similar operations grouped together (Chen: 
section 3.1). 

As per independent claim 42, Mao discloses a computer program product stored 
on a computer-readable storage medium for using a paper document to retrieve 
multimedia information stored electronically in a multimedia document, wherein a first 



Application/Control Number: 1 0/001 ,894 Page 28 

Art Unit: 2178 

plurality of user-selectable identifiers are printed on the paper document, the computer 
program product comprising: 

• Code for receiving a signal indicating selection of a plurality of user-selectable 
identifiers from the first plurality of user-selectable Identifiers printed on the paper 
document (Figure 4, items 404, 406, 414, and 416) 

• Code for responsive to receiving the first signal, identifying portions of multimedia 
information stored by the multimedia document corresponding to the second 
plurality of user selectable identifiers (Figure 4, items 410, 41 1 , and 412) 

• Code for outputting the portions of the multimedia Information con'esponding to 
the second plurality of user-selectable identifiers using an output device (Figure 
4, item 415) 

Mao falls to disclose the second plurality of user-selectable identifiers being a subset of 
the first plurality of user-selectable identifiers. However, Chen discloses organizing 
items into subsets (Figure 3; section 3). 

It would have been obvious to one of ordinary skill In the art at the time of the 
applicant's invention to have combined Mao's method of outputting multimedia 
infomnation with Chen's method of organizing user-selectable identifiers into subsets, 
since it would have allowed a user to have similar operations grouped together (Chen: 
section 3.1). 

13. Claims 14, 30, and 43 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mao and Chen in further view of Myers. 
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As per dependent claim 14, IVIao and Chen discloses the limitations similar to 
those In claim 13, and the same rejection is incorporated herein. Mao and Chen fail to 
disclose determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia infomiation stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia infonnation corresponding to the first user-selectable identifier. 
However, Myers discloses determining a first time and a second time corresponding to 
the first user selectable Identifier and including a portion of multimedia information 
stored by the multimedia document occurring between the first time and the second 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier (section 6.5: Here, the first and second identifiers are inherent. Myers 
discloses playback of a "selected portion of the video." For this to occur, a first (start) 
time and a second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao and Chen's method of multimedia playback 
with Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 30, Mao and Chen discloses the limitations similar to 
those in claim 29, and the same rejection is incorporated herein. Mao and Chen fail to 
disclose determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia infomiation stored by the 
multimedia document occurring between the first time and the second time in the 
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portion of multimedia information corresponding to the first user-selectable identifier. 
However, Myers discloses determining a first time and a second time corresponding to 
the first user selectable identifier and including a portion of multimedia information 
stored by the multimedia document occurring between the first time and the second 
time in the portion of multimedia information corresponding to the first user-selectable 
identifier (section 6.5: Here, the first and second identifiers are inherent. Myers 
discloses playback of a "selected portion of the video." For this to occur, a first (start) 
time and a second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's Invention to have combined Mao and Chen's method of multimedia playback 
with Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 

As per dependent claim 43, Mao and Chen discloses the limitations similar to 
those In claim 42, and the same rejection is incorporated herein. Mao and Chen fail to 
disclose determining a first time and a second time corresponding to the first user 
selectable identifier and including a portion of multimedia information stored by the 
multimedia document occurring between the first time and the second time in the 
portion of multimedia information corresponding to the first user-selectable identifier. 
However, Myers discloses determining a first time and a second time corresponding to 
the first user selectable identifier and including a portion of multimedia information 
stored by the multimedia document occurring between the first time and the second 
time in the portion of multimedia information corresponding to the first user-selectable 
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identifier (section 6.5: Here, the first and second identifiers are inherent. Myers 
discloses playback of a "selected portion of the video." For this to occur, a first (start) 
time and a second (end) time must be predetermined by the user). 

It would have been obvious to one of ordinary skill in the art at the time of the 
applicant's invention to have combined Mao and Chen's method of multimedia playback 
with Myers's method of multimedia playback, since it would have allowed a user to view 
sections of the multimedia document without having to view the entire document. 
14. Claims 15, 31, and 44 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mao. 

As per independent claim 15, Mao discloses the computer-implemented method 
of retrieving multimedia information using a first paper document and a second paper 
document, wherein one or more user-selectable identifiers are printed on the first paper 
document and one or more user-selectable identifiers are printed on the second paper 
document, the method comprising: 

• Receiving a signal indicating selection of a first user-selectable identifier from the 
one or more user-selectable identifiers printed on the first paper document, and 
indicating selection of a second user-selectable identifier from the one or more 
user-selectable identifiers printed on the second paper document (Figure 4, items 
404, 406, 414, and 416: Here, several different identifiers can be scanned, as the 
figure shows no limit on the number of times the method may be performed.) 
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• Identifying a portion of multimedia information corresponding to the first user- 
selectable identifier from multimedia information stored by a first multimedia 
document (Figure 4, items 408, 418, and 410) 

• Identifying a portion of multimedia information corresponding to the second user- 
selected identifier from multimedia information stored by a second multimedia 
document (Figure 4, items 408, 418, and 410) 

• Outputting the portion of multimedia information stored by the first multimedia 
document corresponding to the first user-selectable identifier and the portion of 
multimedia information stored by the second multimedia document 
corresponding to the second user-selectable identifier using an output device 
(Figure 4, item 415: Here, it was well known that a display may display more than 
one set of information at a time. For example, a monitor may display several 
windows of information on the screen tiled, split, or in another manner) 

As per independent claim 31 , Mao discloses a system for retrieving multimedia 
information using a first paper document and a second paper document, wherein one or 
more user-selectable identifiers are printed on the first paper document and one or 
more user-selectable identifiers are printed on the second paper document, the system 
comprising: 

• An output device (Figure 4, item 41 5) 

• A data processor (Figure 4, item 411) 

• Wherein the data processor is configured to: 



Application/Control Number: 1 0/001 ,894 Page 33 

Art Unit: 2178 

• Receive a signal indicating selection of a first user-selectable identifier from the 
one or more user-selectable identifiers printed on the first paper document, and 
indicating selection of a second user-selectable identifier from the one or more 
user-selectable identifiers printed on the second paper document (Figure 4. items 
404, 406, 414, and 416: Here, several different identifiers can be scanned, as the 
figure shows no limit on the number of times the method may be performed.) 

o Identify a portion of multimedia information corresponding to the first user- 
selectable identifier from multimedia Infomriation stored by a first 
multimedia document (Figure 4, items 408, 418, and 410) 

o Identify a portion of multimedia information corresponding to the second 
user-selectable identifier from multimedia information stored by a second 
multimedia document (Figure 4, items 408, 418, and 410) 

o Communicate the portion of multimedia infomnation stored by the first 
multimedia document corresponding to the first user-selectable identifier 
and the portion of multimedia information stored by the second multimedia 
document corresponding to the first user-selectable identifier to the output 
device (Figure 4, items 410 and 412) 

• Wherein the output device is configured to output the portion of multimedia 
infomiation corresponding to the first user-selectable identifier and the portion of 
multimedia information corresponding to the second user-selectable identifier 
received from the data processor (Figure 4, item 415: Here, it was well known 
that a display may display more than one set of information at a time. For 



Application/Control Number: 1 0/001 ,894 Page 34 

Art Unit: 2178 

example, a monitor may display several windows of information on the screen 
tiled, split, or in another manner) 

As per independent claim 44, Mao discloses a computer program product stored 
on a computer-readable storage medium for retrieving multimedia information using a 
first paper document and a second paper document, wherein one or more user- 
selectable identifiers are printed on the second paper document, the computer program 
product comprising: 

• Code for receiving a signal indicating selection of a first user-selectable identifier 
from the one or more user-selectable identifiers printed on the first paper 
document, and indicating selection of a second user-selectable identifier from the 
one or more user-selectable identifiers printed on the second paper document 
(Figure 4, items 404, 406, 414, and 416: Here, several different identifiers can be 
scanned, as the figure shows no limit on the number of times the method may be 
performed.) 

• Code for identifying a portion of multimedia information corresponding to the first 
user-selectable identifier from multimedia information stored by a first multimedia 
document (Figure 4, items 408, 418. and 410) 

• Code for identifying a portion of multimedia information corresponding to the 
second user-selected identifier from multimedia information stored by a second 
multimedia document (Figure 4, items 408, 418, and 410) 

• Code for outputting the portion of multimedia information stored by the first 
multimedia document corresponding to the first user-selectable identifier and the 
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portion of multimedia information stored by the second multimedia document 
corresponding to the second user-selectable identifier using an output device 
(Figure 4, item 415: Here, it was well known that a display may display more than 
one set of information at a time. For example, a monitor may display several 
windows of information on the screen tiled, split, or in another manner) 



Conclusion 

1 5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

• Carro (US 2002/004870): Discloses a method and system for locating on a 
physical document items referenced in an electronic document 

• Hull et al. (US 6684368): Discloses a method for specifying delivery information 
for electronic documents 

• Parks (US 6596031 ): Discloses a markup language and system for document 
editing and processing 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kyle R Stork whose telephone number is (571) 272- 
4130. The examiner can normally be reached on Monday-Friday (7:00-3:30). 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on (703) 308-5465. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Kyle Stork 
Patent Examiner 
Art Unit 21 78 





